A Hybrid Approach to Identifying Objects from Verbal Descriptions
نویسندگان
چکیده
In this paper we present a hybrid approach for the identification of objects in a scene from spoken verbal descriptions. An integrated knowledge base realized by a semantic network is used to build conceptual descriptions of a scene observed by cameras as well as of an utterance possibly referring to one or more objects in that scene. The object identification problem is solved using Bayesian networks. The matrices for the nodes and links of the Bayesian networks are estimated from the results of psycholinguistic experiments with naive users.
منابع مشابه
Saliency Cognition of Urban Monuments Based on Verbal Descriptions of Mental-Spatial Representations (Case Study: Urban Monuments in Qazvin)
Urban monuments encompass a wide range of architectural works either intentionally or unintentionally. These works are often salient due to their inherently explicit or hidden components and qualities in the urban context. Therefore, they affect the mental-spatial representations of the environment and make the city legible. However, the ambiguity of effective components often complicates their...
متن کاملIdentifying and inferring objects from textual descriptions of scenes from books
Fiction authors rarely provide detailed descriptions of scenes, preferring the reader to fill in the details using their imagination. Therefore, to perform detailed text-to-scene conversion from books, we need to not only identify explicit objects but also infer implicit objects. In this paper, we describe an approach to inferring objects using Wikipedia and WordNet. In our experiments, we are ...
متن کاملA Corpus of Natural Multimodal Spatial Scene Descriptions
We present a corpus of multimodal spatial descriptions, as commonly occurring in route giving tasks. Participants provided natural spatial scene descriptions with speech and abstract deictic/iconic hand gestures. The scenes were composed of simple geometric objects. While the language denotes object shape and visual properties (e.g., colour), the abstract deictic gestures “placed” objects in ge...
متن کاملHybrid method for full identification of buried objects and surrounding media
This study describes a hybrid technique for identification of buried objects. The objects shape and electromagnetic profile are reconstructed from evaluations of electrical permittivity and conductivity. The method suggests a combination of linear sampling and optimization. Linear sampling method (LSM) is used to recover shape and metaheuristic optimizations essential to reconstruct the inside...
متن کاملObjects Identification in Object-Oriented Software Development - A Taxonomy and Survey on Techniques
Analysis and design of object oriented is onemodern paradigms for developing a system. In this paradigm, there are several objects and each object plays some specific roles. Identifying objects (and classes) is one of the most important steps in the object-oriented paradigm. This paper makes a literature review over techniques to identify objects and then presents six taxonomies for them. The f...
متن کامل